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Abstract 


Beginning  with  World  War  n  and  its  aftermath,  the  area  of  ballistic  vulnerability/lethality 
(V/L)  was  first  defined  as  a  specific  discipline  within  the  field  of  ballistics.  As  the  field 
developed,  various  practices  and  metrics  emerged,  hi  some  cases  metrics  were  developed  that 
woie  abstractly  useful  but  bore  no  direct  relationship  to  field  observables,  hr  the.  last  decade,  as 
issues  concerning  Uve-Fire  strategies  have  gained  importance,  increased  attention  has  been 
focused  on  V/L  with  the  intent  of  bringing  greater  rigor  and  clarity  to  die  discipline,  hr  part  this 
effort  has  taken  the  form  of  defining  a  VfL  Taxonomy,  which  is  a  method  of  decomposing  a 
series  of  concatenated  complex  processes  into  separable,  less-complex  operations,  each  with 
certain  specifiable  properties  and  relationships. 

Using  the  Taxonomy,  diis  report  describes  the  most  commonly  used  V/L  metrics  are  a 
function  of  platform  aggregate  damage,  reduced  platform  capability,  and  reduced  military 
utility.  We  show  that  these  three  distinct  and  separable  classes  of  metrics  are  linked  by  operators 
that  are  multivariate,  stochastic,  and  nonlinear.  We  also  show  that  it  is  useful  to  form  probability 
distributions  with  respect  to  initial  and  boundary  conditions  in  ordo*  to  characterize  damage, 
capability,  and  utility.  Many  defense  community  studies  ignore  diese  distinctions  to  the 
detriment  of  fundamental  clarity.  Examples  are  given  and  potential  remedies  described. 
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Preface 


This  report  is  an  expanded  version  of  a  paper  presented  at  the  8th  Annual  Tank-Automotive 
Research,  Development,  and  Engineering  Center  Symposium,  held  at  the  Naval  Postgraduate  School 
in  Monterey,  CA,  25-27  March  1997. 
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ABSTRACT 

Beginning  with  World  War  n  and  its  aftermath,  the  area  of  ballistic  vulnerability/lethality 
(V/L)  was  first  defined  as  a  specific  discipline  within  the  field  of  ballistics.  As  the  field  devel- 
c^ed,  various  practices  and  metrics  emerged.  In  some  cases  metrics  were  developed  that  were 
abstractly  useful  but  bore  no  direct  relationship  to  field  observables.  In  the  last  decade,  as  issues 
concerning  Live-Fire  strategies  have  gained  importance,  increased  attention  has  been  focused  on 
V/L  with  the  intent  of  bringing  greater  rigor  and  clarity  to  the  discipline.  In  part  this  effort  has 
taken  the  form  of  defining  a  VIL  Taxonomy,  which  is  a  method  of  decomposing  a  series  of  con¬ 
catenated  complex  processes  into  separable,  less-complex  operations,  each  with  cotain  specifi¬ 
able  prop^es  and  relationships. 

Using  the  Taxonomy,  this  report  describes  how  the  most  commonly  used  V/L  metrics  are  a 
function  of  platform  aggregate  cUimage,  reduced  platform  capability,  and  reduced  platform  mili¬ 
tary  utility.  We  show  that  these  three  distinct  and  separable  classes  of  metrics  are  linked  by  oper¬ 
ators  that  are  multivariate,  stochastic,  and  nonlinear.  We  also  show  that  it  is  useful  to  form  prob¬ 
ability  distributions  with  respect  to  initial  and  boundary  conditions  in  order  to  characterize  dam¬ 
age,  capability,  and  utility.  Many  defense  community  studies  ignore  these  distinctions  to  the 
detriment  of  fundamental  clarity.  Examples  are  given  and  potential  remedies  described. 


INTRODUCTION 

Beginning  with  World  War  11  and  its  aftermath,  the  area  of  ballistic  vulnerability/lethality  (V/L)  was  first 
defined  as  a  specific  discipline  within  the  field  of  ballistics.  As  the  field  developed,  various  practices  and  metrics 
emerged.  Certainly  the  best-known  metrics  normally  produced  by  the  V/L  community  are  “PKs”  or  “Probability  of 
Kills.”  Following  the  establishment  of  Live-Fire  regulation*  in  Ae  last  decade,  the  concomitant  issues  of  Live-Fire 
Test  (LFT)  strategies  and  model  verification,  validation,  and  accreditation  (W&A)  have  gained  importance. 
Increased  attention  has  been  focused  on  V/L  with  the  intent  of  bringing  greater  rigca:  and  clarity  to  the  discipline. 
For  example,  some  of  the  V/L  metrics  used  for  many  years  and  conunonly  referred  to  as  “PKs”  are  not  probabilities 
at  all  but  are  a  kind  of  expected-value  utility  function,  constructed  with  the  aim  of  describing  the  battle  value  of  a 
damaged  platform.  However,  long-standing  practice  in  the  wargame  modeling  communities  has  been  to  use  these 
numbers  as  probabilities. 

The  outcomes  of  actual  live-fire  field  shots  have  often  been  assessed  in  terms  of  probabilities  of  kill,  in  spite  of 
the  fact  that  what  has  been  observed  is  in  fact  a  single  outcome  from  a  probability  space.  This  practice  is  conceptu¬ 
ally  equivalent  to  reporting  a  football  game  outcome  after  the  fact  in  terms  of  a  probability  of  win. 

The  particular  focus  of  this  report  is  on  the  proper  coupling  of  V/L  metrics  with  watgames  and  other  emerging 
forms  of  distributed  force-level  simulation.  Our  purpose  here  is  not  to  decry  the  methods  and  practices  of  our  fore¬ 
bears,  but  rather  to  describe  a  logical  set  of  steps  associated  with  the  practice  of  V/L,  and  how  they  now  might  be 
implemented  in  the  emerging  world  of  increasingly  powerful  computers,  high-level  architectures,  and  distributed 
interactive  simulations. 


1.  Live  Fire  Testing.  National  Defense  Aulborization  Act  for  FY 1987,  Chapter  139,  Section  2366  ofTitle  10,  United  States  Code. 
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V/L  FRAMEWORK 

We  recall  that  vulnerability  generally  refers  to  the  assessment  <rf  damage  and  dysfunction  visited  on  a  blue 
(friendly)  military  platform.  By  contrast,  lethality  generally  refers  to  the  assessment  of  damage  and  dysfunction  cm  a 
red  military  platform.  Starting  about  a  decade  ago,  we  have  asserted  that  the  study  of  vulMrability  can  be  separated 
into  four  fully  separable  and  sequential  levels  or  spaces  each  coimected  with  a  mapping  operator.  These  noticMS  are 
explained  in  detail  elsewhere,^'^and  we  build  upon  those  ideas  here. 

The  totality  of  vulnerability  can  be  partitioned  among  three  kinds  of  descriptcxs:  (1)  damage  to  the  target,  (2) 
loss  of  platform  (Le.,  target)  functional  capability,  and  (3)  reduction  in  battlefield  utility.  Each  of  these  descriptors  is 
characterized  using  the  V/L  Taxonomy  abstraction. 


Levels,  Operators,  and  Mapping  Abstraction 

Figure  1  illustrates  six  levels  (or  mathematical  spaces)  labeled  Level  -1]  through  Level  4].  Each  Level  repre¬ 
sents  distinct  and  separable  classes  of  observables  coveting  the  gamut  of  we^ns  effectiveness.  Each  bullet  in  a 
Level  r^resents  a  vector,  which  is  charact^ized  by  a  set  of  physical  parameters.  The  composition  of  the  vectors  at 
each  level  is  particular  to  the  Level.  A  vector  at  one  Level  can  be  m^ped  to  a  vector  at  the  next  Level  by  an  Oper¬ 
ator.  The  operators  are  represented  by  the  notation  O  ,  in  which  p  represents  the  Level  on  which  the  input  vector 

(v  )  resides  and  q  denotes  the  Level  on  which  the  output  vector  (v^)  resides.  Thus  a  vector  at  the  p  level  can  be 
written: 


V 

4 


O  {v  }  . 

M  '  P'* 


(1) 


It  is  impotant  to  understand  that  the  vector  v^  has  specific  observable  physical  or  engineering  properties  and  is  not  a 
probability.  However,  the  operator  ^  is  normally  stochastic,  so  probability  distributions  can  be  inferred  by  repeti¬ 
tively  operating  on  a  single  v^  vector  in  order  to  generate  a  population  of  v^  vectors. 


Mapping 

For  reasons  that  become  clear  later,  we  will  start  with  Level  1]  as  depicted  in  Fig.  1.  Each  bullet  within  the 
space  of  Level  1]  represents  a  vector  describing  the  warhead  (or  threat)  and  target  (including  kinematics)  as  a  vul¬ 
nerability  event  is  initiated.  Table  I  gives  a  listing  of  the  levels,  vectors,  and  vector  descriptors.  A  useful  way  to 
view  the  vector  v^  is  as  a  descriptor  for  the  initial  conditions  for  a  live-fire  shot.  The  operator  is  the  nonlinear, 

multivariate,  stochastic  operator  that  maps  live-fire  initial  conditions  to  Level  2],  damaged  components. 

At  Level  2]  the  outcome  space  of  vectors  represents  the  list  of  platform  components  either  not  killed  (o)  or 
killed  (b).^  This  information  is  extremely  valuable  and  provides  the  foundation  for  all  further  vulnerability.  The 
damage  vector  enumerates  crew  casualties,  ammunition,  and  fuel  catastrt^hic  events  and  the  status  of  all  other  criti¬ 
cal  and  ancillary  components  on  board  the  platform.  At  this  point  platform  survivability  is  assessed.  One  of  the 
lessons  learned  from  live-fire  and  the  supporting  modeling  efforts  is  that  the  outcome  space  at  Level  2]  is  large. 
For  some  overmatching  munitions  against  armored  ground  vehicles,  we  estimate  an  outcome  space  in  excess  of 


2.  Paul  H.  Deitz  and  Aivars  Ozolins,  Computer  SimulaHons  of  the  Abrams  Uve^Fire  Field  Testings  Proceedings  of  the  XXVII  Annual  Meeting 

of  the  Anny  Operations  Research  Symposium,  12’13  October  1988,  Fort  Lee,  also  US  Army  Ballistic  Research  Laboratory  Meroo« 

randum  Report  BRL-MR*3755,  May  1 989. 

3.  J.  Tenence  Klopdc,  Michael  W.  Starks,  and  James  N.  Walbert,  A  Taxonomy  for  die  VulnerabiUtyl Lethality  Analysis  Process,  US  Army  Bal¬ 
listic  Research  Laboratory  Memorandum  Report  BRL-MR-3972,  May  1992. 

4.  Paul  H.  Deitz,  A  VIL  Taxonomy  for  Analyzing  Ballistic  Uve^Fire  Events,  Proceedings  of  the  46th  Annual  Bomb  &  Warhead  Technical 
SynqMsium,  13-15  May  1996,  Monterey,  CA;  also  appears  in  Modeling  Ballistic  Live^Fire  Events  Trilogy,  US  AniQf  Research  Laboratory 
Technical  Report  ARL-TR-1274,  December  1996. 

X  Throughout  the  V/L  business  there  is  a  seminal  issue  that  involves  the  characterization  of  damage.  In  the  extreme,  the  analyst  can  choose 
damage  descriptors  that  are  either  Bernoulli  in  outcome  (kill/no-kill)  or  fractional  (values  0.0  ^  [Fractional  Capability]  ^  1.0).  This  issue 
arises  not  only  with  component  damage  at  Level  2]  but  with  platform  capability  at  Level  3]  as  well  The  Army  Research  Laboratory  general¬ 
ly  uses  the  Bernoulli  method  to  describe  con^onent  dysfunction  for  a  number  of  theoretical  and  pragmatic  reasons.  This  issue  is  discussed 
further  in  Paul  H.  Deitz,  Jill  H.  Smith,  and  John  H.  Suckling,  Comparisons  of  Field  Tests  with  Simulations:  Abrams  Program  Lessons 
Learned,  Proceedings  of  the  XXVm  Annual  Meeting  of  the  Army  Operations  Research  Sympoaum,  11-12  October  1989,  Fort  Lee, 
VA,  pp.  108-128;  also  US  Army  Ballistic  Research  Laboratory  Memorandum  Report  BRL-MR-3814,  March  1990.  See  also  the  Ap¬ 
pendix  to  Ref.  14. 
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Levels  -  Descriptors 


Level  -1] 
Weapon 
Detection- 
Identification 
Conditions 


Level  0] 

Threat-Launch 

Initial 

Conditions 


Level  1] 

Threat-Target 
(or  Platform) 
Initial 
Conditions 


Level  2] 

Target 

(or  Platform) 

Damaged 

Components 


Level  3] 

Measures  of 
Target 

(or  Platform) 
Capability 

Level  4] 

Measures  of 
Target 

(or  Platform) 
Utility 


TYansformations 

O  j  ^  Operator 

Weapon  Detection- 
Identification  Initial 
Conditions  to  Warhead 
Launch  Initial  Conditions 

Oo,i  Operator 

Warhead  Launch 
^  Initial  Conditions  to 
Target  Arrival 
Initial  Conditions 

^1,2 

Threat-Target 
Initial  Conditions  to 
Platform 

Damaged  Components 

O  Operator 

Target  Damaged 
Components  to 
Platform  Measures- 
of-Capability 

O  Operator 

3»4 

Taiget  Measuies- 
of-Opability  to 
Platform  Battlefield 
Utility 


Fig.  1.  V/L  Taxonomy  illustraU^  via  a  Mapping  Abstraction.  The  ellipses  in  the  middle  column  represent 
mathematical  spaces.  The  bullets  (•)  contained  within  the  spaces  represent  vectors  (represented  elsewhere  in 
the  paper  as  v^).  The  arrows  represent  mapping  curators  that  take  a  vector  at  one  Level  and  perfcnm  a  map¬ 
ping  to  the  next  lower  Level.  On  the  left,  the  descriptors  for  the  various  levels  are  given;  on  the  right,  the 
actions  of  the  various  operators.  Note  the  single  connected  path  of  arrows  from  Level  -1]  to  Level  4]  r^resents 
a  single  sample  in  an  end-to-end  connected  process.  As  shown  here,  the  initial  conditions  at  Level  -1]  could  be 
drawn  stochastically  or  input  deterministically.  Since  many  of  the  succeeding  operators  (O  to  Oj^)  are 
stochastic,  the  results  from  Level  0]  through  Level  4]  usually  represent  a  set  of  connected  stochastic  metrics  in 
outcome  space. 
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Level 

Vector 

Vector  Descriptors 

-1] 

Fhydcal  Characteristics  Leading  to  Decision  to  Fire 

0] 

Physical  Characteristics  of  Threat  at  Launch 

1] 

Threat  Geometry  &  Material, 

Platform  Geometry  &  Material, 

Threat  Kinematics  &  Orientation  vs.  Platform 

2] 

Status  of  Platform  Damage: 

Le.,  Non-Killed  ( □ )  and  Killed  ( ■ )  Components 
Platform  Survivability 

3] 

natform  Capability: 

e.g..  Mobility,  Firepower,  and  Commo  Functions 

4] 

^^4 

Platform  Utility: 

e.g..  Does  natform  Survive?  (Fnmi  Level  2]), 

Does  natform  Perform  Specific  Mission? 

Table  L  Composition  of  Vectors  at  Each  Level.  In  the  left  column  are  the  levels  ccMiesponding  to 
those  shown  in  Fig.  1 .  In  the  middle  are  the  related  vector  symbols.  On  the  right  are  descriptions  of 
the  vector  compositions  at  each  level. 

30  X  10*.  This  makes  model  validation  problematic  for  multiple  reasons.  The  size  of  the  outcome  space  precludes 
exercising  the  model  sufficiently  even  to  compute  a  simple  majority  of  the  possible  predicted  outcomes.  Having 
normally  only  a  single  field  outcome  to  compare  with  the  model  provides  limited  utility. 

Mapping 

As  noted  in  Fig.  1,  the  operator  takes  a  Level  2]  damage  vector  and  maps  it  to  a  platform-level  capability 

veaor  at  Level  3].  Such  vectors  are  normally  measurable  quantities  that  relate  directly  to  the  ability  of  the  platform 
to  support  particular  mission  functions.  Table  I  lists  Mobility,  Firepower,  and  Communication  as  Qcamples.  In  a  later 
section,  we  further  refine  these  capabilities  and  show  how  they  can  be  appropriately  linked  to  a  wargame.  The  O,, 
mapping  process  was  developed  at  the  US  Army  Research  Laboratory  (ARL)  over  the  past  decade  ’  and  is  called 
the  Degraded  States  Vulnerability  Methoddogy.  The  methods  have  been  applied  to  a  number  of  ground^  and  air 
systems.®  Additionally,  this  mapping  replicates  the  Reliability,  Availability,  and  Maintainability  (RAM)  process^  as 
well  as  the  inverse  path  needed  to  effect  the  repair  of  battle  d^age.  We  suggest  that  Level  3]  metrics  correspond  to 
what  the  Operations  Research  community  normally  refers  to  as  Measures-of-Performance  (MoPs). 


5.  John  M.  Abell,  Lisa  K.  Roach,  and  Midiael  W.  Starks,  Degraded  States  Vulnerability  Analysis^  US  Arnqr  Ballistic  Research  Laboratory 
Teehnical  Report  BRL-TR-3010,  June  1989. 

6.  Lisa  K.  Roach,  The  New  Degraded  States  Vulnerability  Methodology  (DSVM):  A  Change  in  Philosophy  and  Approach,  US  Army  Research 
Laboratory  Technical  Report  ARL-TR-1223,  November  1996. 

7.  John  M.  Abell,  Mark  D.  Burdeshaw,  and  Bruce  A.  Rickter,  Degraded  States  Vulnerability  Analysis:  Phase  /,  US  Army  Ballistic  Research 
Laboratory  Technical  Report  BRL-TR-3161,  October  1990. 

8.  Robert  W.  Kunkel,  Jr.,  Degraded  States  and  Fault  Tree  Analysis  of  the  LONGBOW  APACHE  (LBA),  US  Army  Research  Laboratory  Tech* 
meal  Report  ARL-TR-801,  July  1995. 

9.  Lisa  K.  Roach,  Fault  Tree  Analysis  and  Extensions  of  the  ViL  Process  Structure,  US  Army  Research  Laboratory  Technical  Report  ARL- 
TR-149.  June  1993. 
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Mapping 

’  In  order  to  execute  property  the  mapping,  we  need  to  move  into  the  context  of  a  wargame.  The  platform 

under  scrutiny  is  located  in  a  certain  place/time.  A  specific  set  of  tactics  and  doctrine  is  in  qperaticm,  and  a  specific 
scenario  is  being  realized.  Let  us  assume  our  platform  has  received  exactly  one  hit.  This  action  has  (presumably) 
caused  some  number  of  components  to  have  been  killed  and,  as  a  result,  some  loss  of  capability  at  Level  3].  The 
(q)erator  O,  .,  based  on  the  next  mission  of  the  game,  calls  for  a  particular  action.  This  action  would  normally  be 

within  the  capability  of  an  undamaged  platform.  If  the  damaged  platfcxm  can  nevertheless  still  perform  the  acticm,  it 
retains  its  battlefield  utility.  If  not,  the  platform  fails.  We  describe  a  notional  example  of  this  process  near  the  end  of 
the  report.  We  believe  that  Level  4]  metrics  correspond  to  what  the  (Operations  Research  community  normally  refers 
to  as  Measures-of-Effectivoiess  (MoEs). 

We  have  posed  this  process  in  the  context  of  a  platform  receiving  its  first  hit  and  first  damage.  In  addition  to  the 
problematic  way  most  current  Level  4]  metrics  are  constructed,*  they  are  normally  used  as  a  basis  for  a  random 
draw  in  the  context  of  the  wargame.  If  the  draw  is  true,  the  vehicle  is  withdrawn  from  the  game.  If  not,  it  continues 
undamaged.  Multiple  hits  of  like  kind  or  damage  from  other  threats  (e.g.,  chemical,  nuclear,  electromagnetic)  are  all 
posed  as  PKs,  under  the  assumption  that  no  prior  damage  has  occurred  to  the  platform.  These  multiple  hits  are  nor¬ 
mally  processed  via  the  Survivor  Rule}  Thus,  in  addition  to  the  individual  metrics  being  flawed,  combining  a 
sequence  of  damages  without  regard  to  the  fact  that  they  have  been  each  calculated  using  a  pristine  (r.e.,  undamaged) 
platfcxm  and  combining  damage  without  regard  to  the  order  in  which  it  has  occurred  by  aggregation  are 
problematic.^ 

,  Mapping 

We  have  so  far  described  the  process  of  vulnerability  begiiuiing  with  Level  1].  The  V/L  Taxonomy  was  origi¬ 
nally  generated  in  order  to  investigate  the  process  of  vuliierability.  Standard  practice  in  vulnerability  is  to  assume  a 
particular  warhead  hit  condition.  This  is  why  the  level  for  vulnerability  initial  conditions  is  labeled  L«vel  1]. 

By  contrast,  lethality  often  includes  a  prefactor  in  vulnerability,  the  warhead  hit  dispersion.  Thus  in  Fig.  1,  we 
have  added  Level  0]  to  connote  the  wariiead  launch  initial  conditions  and  the  operator  j,  which  takes  the  warhead 

and  computes  the  dispersion  statistics  as  input  (as  needed)  to  Level  1]  for  a  subsequent  computation. 

Mapping 

For  completeness,  we  have  added  Level  -1].  This  is  the  level  in  which  the  inputs  into  the  target  detection  and 

identification  processes  fit.  The  operator  O , .  takes  the  relevant  initial  conditions  and  maps  them  both  to  a  decision 

•1,0 

to  fire  and  the  configuration  of  the  threat  launcher. 

Stochastic  Mapping,  Repeated  Sampiing,  and  Probabiiities 

Tiiming  our  attention  once  again  to  Fig.  1 ,  we  have  described  six  levels  connected  by  five  mapping  cperators. 
Although  some  of  the  operators  are  stochastic,^  no  vector  outccxne  at  any  of  the  Levels  is  a  probability.  lire  set  of 
connected  mapping  arrows  begins  by  initiating  an  action  at  Level  •!]  and  carries  the  continuous  thread  through  to 
Military  Utility  at  Level  4].  If  probability  distributions  are  needed  at  any  particular  level,  they  can  be  inferred  by 
repetitively  initiating  model  runs  beginning  at  least  one  level  above  the  particular  level  of  interest. 


oo  As  we  discuss  later,  most  ground*system  PKs  actually  begin  life  as  a  ^‘fractional  loss  of  battlefield  utility**  and  then  aie  averaged  over  a  wide 
range  of  weighted  missions.  Hiey  are  mistakenly  assumed  equivalent  to  and  used  as  PKs. 
t  The  Survivor  Rule  as  used  here  states  that  the  overall  PK  for  a  platform  attacked  by  n  independent  threats,  eadi  characterized  with  its  own 
PK.,  is  given  by: 

pa:  =  1 -[i  1 -pjs:, ] x[  1 -pjfa ]x...[  1 -Pii:, ]]  . 

□  Lest  the  reader  think  this  is  not  a  problem,  consider  the  cases  of  (1)  an  aitilleiy  attack  on  an  armored  personnel  carrier  (APC)  that  causes  a 
number  of  perforations  to  the  armor  but  otherwise  does  no  damage,  followed  by  (2)  the  deposit  of  a  diemical  agent  on  the  APC.  These  at¬ 
tacks  when  assessed  independently  against  the  APC  have  no  effect  When  assessed  together,  the  outcome  might  be  very  different 
§  Operators  O  ,  O  and  O  are  fully  stochastic.  The  representation  of  the  O  operator  via  the  current  Degraded  States  Vulnerability 
Methodology  is  currently  deterministic.  Hie  miqiper  could  be  implemented  either  way.  A  deterministic  method  would  probably  be  ade¬ 
quate. 


-5- 


Level  p] 


Fig.  2.  Examples  of  Expansive  and  Contractive  Mappings.  On  the  left  is  an  example  of  multi¬ 
ple  mappings  that  go  from  few  to  the  many.  On  the  right  is  an  mcample  of  multiple  mailings  that 
go  from  many  to  few. 

In  order  to  gain  a  sense  of  how  the  stochastic  replications  might  behave,  we  refer  to  Fig.  2.  On  the  left  is  an 
example  of  what  might  be  called  an  Expansive  Mapping.  In  this  case,  a  single  set  of  inputs  (indicated  by  a  single 
vector  at  Level  p]),  when  repetitively  mapped,  will  tend  to  terminate  at  different  vectors  (at  Level  q]).  Our  model¬ 
ing  experience  tells  us  that  the  Operators  0_j  j,  and  can  be  expected  to  behave  this  way.  The  opera¬ 
tor,  as  implemented  via  Degraded  States,  is  deterministic  and  strictly  a  one-to-one  mapping.  Since  the  dimensions 
of  Level  3]  are  far  lower  than  Level  2],  the  operator  and  most  likely  the  ^  operator  will  have  the  effect  of 

contracting  the  number  of  vectors  in  the  outcome  levels.  This  behavior  is  illustrated  cm  the  right  of  Fig.  2. 

The  overall  picture  one  can  gain  from  the  process  when  repetitively  sampled  from  top  to  bottom  is  one  in  which 
the  population  of  vectors  grows  rapidly  through  Levels  0]  through  2]  and  then  contracts  rapidly  through  Levels  3] 
and  4].  The  very  magnitude  in  the  population  of  the  intermediate  levels  attests  to  the  specific  nature  of  the  vectors  at 
a  given  level  and  the  way  in  which  they  feed  into  the  ensuing  operator.  Clearly,  unless  these  statistics  are  understood 
very  well  for  the  ranges  of  needed  parameters,  averaging  at  too  low  a  level  can  place  ensuing  results  in  doubt. 

Lethality  Contrasted  with  Vulnerability 

Previously  we  noted  some  typical  differences  between  the  way  lethality  and  vulnerability  are  normally  con¬ 
strued.  In  Fig.  3,  we  have  reproduced  the  six  levels  and  have  attempted  to  show  how  various  descriptive  labels  are 
normally  used  by  the  community  at  latge.^ 

Although  many  of  the  tools  for  V/L  are  commonly  shared,  there  are  differing  motives  for  those  who  develop 
weapons  (e.g.,  missiles  and  gun  munitions)  and  examine  lethality  vs.  those  building  military  platforms  ({.«.,  ships, 
tanks,  aircraft)  who  focus  on  vulnerability.  The  ccmcems  of  the  fomer  are  shown  on  the  left  from  the  standpoint  of 
Threat-LethaKty  Orientation.  The  ccmcems  of  the  latter  are  shown  on  the  right  from  the  standpoint  of  Piatform-Sur- 
vivability  Orientation.  From  the  Standpoint  of  weapons  optimization.  Lethality  is  shown  as  begirming  with  the 
weapon  launch.  Overall  Eflectiveness  might  extend  the  process  back  one  level  to  include  Target  Detection-Identifica¬ 
tion.  From  the  standpoint  of  platform  survivability,  vulnerability  is  shown  as  the  end-game  process  beginning  with 
the  munition  hit.  Susceptibility  can  be  viewed  as  ^1  of  the  prior  processes  that  lead  to  the  hit  initiation  at  Level  1]. 
Survivability  can  be  viewed  as  the  end-to-end  process  in  which  susceptibility  and  vulnerability  are  combined. 

One  important  manifestation  of  the  difference  in  which  these  two  conununities  view  their  need  sets  can  be  seen 
in  the  context  of  Live  Fire.  A  Project  Manager  (PM)  develqring  a  new  ntissile  seeks  assurance  that  the  missile  will 
be  sufficiently  lethal  against  a  given  target  class.  The  need  includes  sufficient  overkill  so  that  future  enemy  counter¬ 
measures  will  not  easily  obviate  weapon  effectiveness.  The  details  about  the  target  damage  or  target  function  are 
probably  not  of  great  concern.  By  contrast,  a  PM  developing  a  blue  platform  is  likely  to  desire  very  specific  infor¬ 
mation  on  both  the  damage  (Level  2]  infcxmation)  as  well  as  performance  changes  (Level  3]  information)  in  order  to 


t  R>r  example,  the  V/L  Taxonomy  illuslrated  in  Fig.  1  can  be  thought  of  as  more  formal  representation  of  the  following  vulnerability  reduction 
laying,  well-known  for  at  least  two  decades  throughout  the  DoD  vulnerability  community:  **Don't  be  detected,  but  if  detected,  don*t  be  hit 
If  hit,  don’t  be  perforated.  If  perforated,  don’t  be  damaged.  If  damaged,  don’t  be  killed.” 
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Levels  -  Descriptors 


Effectiveness 


Level  -1] 

Weapon  Detection- 
Identification 
fiiitial  Conditicms 


Level  0] 

Tbreat-Launch 

Initial 

Conditions 


Level  1] 

Threat-Target 

(or  Platform)  Initial 

Conditions 


1 


Susceptibility 


Survivability 


Lethality 


{: 


Level  2] 

Target  (or  Platform) 

Damaged 

Components 


Level  3] 

Measures  of 
Target  (or  Platform) 
Capability 


Level  4] 

Measures  of 
Target  (or  Platform) 
Utility 


1 

Vulnerability 

]>  - 


Threat-Lethality  Orientation 


natform-Survivability  Orientation 


Fig.  3.  Levels  of  Relevance  to  Lethality  and  Vulnerability.  Lethality  and  VulnCTability  are  often  used  to  pur¬ 
sue  different  agendas,  l^pically.  Lethality  is  analyzed  beginning  with  the  weapons  launch  at  Level  0].  Thus, 
warhead  hit  dispersion  at  the  target  is  factored  in.  To  estimate  complete  weapons  Effectiveness,  weapon  target 
detection  and  identification  must  be  included  as  well.  By  contrast.  Vulnerability  normally  starts  with  an 
assumed  hit  at  Level  1],  Susceptibility  covers  all  of  the  prior  factors  leading  up  to  a  hit.  Survivability  provides 
the  overall  accounting. 
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assess  crew  casualties  as  well  as  platform  effectiveness  and  the  possibility  of  eliminating/mitigating  damage  through 
potential  design  variants. 

PAST  WARGAME  EFFECTIVENESS  PRACTICE 

In  what  follows,  we  criticize  past  and  existing  practice  concerning  the  representation  of  attrition  in  force-level 
combat  models,  simulations,  and  wargames.  Fairness  requires  us  to  acknowledge,  however,  that  much  of  what  we 
find  objectionable  in  current  methods  of  attrition  modeling  was  in  the  first  instance  promoted  by  mistakes  and 
unclarities  within  the  technical  V/L  community.  In  prior  decades,  the  comparatively  limited  capabilities  of  comput¬ 
ing  hardware/software  contributed  to  pressures  to  keep  methods  simple.  We  have  written  concerning  these  problems 
elsewhere;  the  point  here  is  to  present  a  top-level  view  of  the  difficulties  so  that  the  relationship  with  the  consequent 
problems  with  force-level  attrition  can  be  clearly  seen. 

As  suggested  previously  in  the  introduction,  one  of  the  early  problems  concerned  lack  of  clarity  in  distin¬ 
guishing  probability  of  kill  from  the  military  utility  of  a  system  with  other  than  full  cmability.  We  have  criticized 
the  identification  of  PK  and  utility  in  detail  elsewhere  for  the  cases  of  tank  vulnerability,*®  personnel  vulnerability,^* 
and  V/L  issues  for  other  classes  of  targets.*^  Without  repeating  those  arguments  here,  suffice  it  to  say  that  questions 
and  methods  for  dealing  with  our  probability  of  winning  the  lottery  are  quite  different  from  those  appropriate  to 
evaluating  the  utility  of  holding  a  winning  ticket. 

We  assert  that  our  predecessors  viewed  the  problem  in  the  following  way.  If  vulnerability  metrics  were  charac¬ 
terized  as  probabilities  —  even  if  mistakenly  —  significant  advantages  accrued.  An  aura  of  mathematical 
respectability  was  cast  over  what  was  an  intrinsically  flawed  intellectual  process.  The  probability  calculus  was  made 
available  as  an  instrument  for  numerical  manipulation.  In  particular,  one  could  multiply  average  hit  probabilities  by 
the  average  probability  of  kill  given  a  hit  values  to  obtain  average  single-shot  kill  pr^abilities  (SSPKs).  We  can 
have  both  appropriate  utility  and  mathematical  consistency  as  well.  There  is  a  tortured  history  concerning  the  use  of 
SSPKs  that  directly  bears  On  the  usual  methods  for  transferring  V/L  infcumation  from  technical  data  providers  to 
force-level  users.  Before  turning  to  that  part  of  the  story,  however,  let  us  dwell  a  bit  longer  on  the  internal  intellec¬ 
tual  problems  with  the  technical  V/L  community. 

One  of  these  problems  is  early  averaging.  Even  if  we  put  to  one  side  the  illegitimate  ruiming  together  of  proba¬ 
bilities  and  utilities  that  the  SSPK  example  illustrated,  early  averaging  remains  a  problem.  Some  of  the  problems 
with  use  of  averages  as  V/L  metrics  are  just  mistakes;  in  other  cases,  the  fault  is  needless  loss  of  valuable  informa¬ 
tion.  One  mistake  is  to  endeavor  to  compare  the  outcome  of  a  test  or  simulation  event  with  an  average  probability.^ 
Pollard  et  al}^  made  this  mistake  concerning  LFT  prediction  and  were  criticized  by  Starks.*^  Another  mistake  is  to 
average  PK  or  SSPK  over  scenarios  and  other  variables  and  then  use  that  PK  in  a  single  one  of  those  scenarios;  this 
is  simply  an  inconsistency,  and  one  that  in  many  cases  infects  the  traditional  V/L  to  fcxce-level  handoff . 

The  problem  of  needlessly  lost  infcsmation  through  early  averaging  can  be  particularly  frustrating  for  analysts 
who  encounter  it.  This  is  so  because,  as  the  discussion  of  the  Taxonomy  showed,  the  information  lost  was  necessar¬ 
ily  at  hand  during  an  intermediate  point  in  the  computation.  Suppose  we  are  conducting  a  study  of  armored  vehicles 
where  it  is  impcxtant  to  know  the  status  of  each  sight.  In  Level  2]  we  clearly  have  a  damage  vector  that  reflects 
whether  a  given  sight  is  functioning  or  not.  If  we  drq)  this  information  after  we  have  used  it  to  calculate  an  average 
mobility  or  firepower  utility,  then  it  is  obviously  not  available  to  answer  specific  questions  about  sights.  It  may  have 


10.  Midiael  W.  Starks,  New  Foundations  for  Tank  Vulnerability  Analysis  (with  1991  Appendix)^  The  Proccedii^s  of  the  Tenth  Anniul  Syntfio* 
num  on  Survivability  and  Vulnerability  of  the  American  Defense  Preparedness  Association,  Naval  Ocean  Systems  Center,  San  Diego, 
CA,  10- 12  May  1988;  also  US  Am^  Ballistic  Research  Laboratory  Memorandum  Report  BRL-MR-3915,  May  1991. 

11.  Midiael  W.  Starks,  Improved  Metrics  for  Personnel  Vulnerability  Analysis^  US  Amiy  Ballistic  Research  Laboratory  Memorandum  Re¬ 
port  BRL-MR-3908,  May  1991. 

12.  Paul  H.  Deitz,  Michael  W.  Starks,  Jill  H.  Smith,  and  Aivars  Ozolins,  Current  Simulation  Methods  in  Military  Systems  Vulnerability  Assess- 
menu  Proceedings  of  the  XXIX  Annual  Meeting  of  the  Army  Operations  Research  Synqiosium,  10-11  October  1990,  F6it  Lee,  VA;  also 
US  Am^  Ballistic  Research  Laboratory  Memorandum  Report  BRL-MR-3880,  November  1990. 

§  Presumably  no  one  in  Green  Bay,  WI,  has  characterized  the  outcome  of  the  1997  Superbowl  in  teniis  of  a  Packer  Probability  of  Win! 

13.  Ray  G.  Pollard,  Gary  L.  Holloway,  Dennis  C.  Bely,  E  TVler  Brown,  and  J.  C.  Kisko,  An  Examination  of  Vulnerability  Predictions  in  Light  of 
Live  Fire  Testing  of  Light  Combat  Vehicles,  The  17th  TWG/AOR  Quadrapartite  Working  Group,  for  AOR,  held  in  Sidney,  Australia,  De¬ 
cember  1987. 

14.  Michael  W.  Starks,  Assessing  the  Accuracy  of  Vulnerability  of  Models  By  Comparison  with  Vulnerability  Ejq>eriments,  US  Army  Ballistic 
Research  Laboratory  Technical  Report  BRL-TR-3018,  July  1989. 
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been  reasonable  to  drop  such  infonnation  in  an  era  when  large  numbers  of  computer  cycles  and  storage  were  less 
available  than  they  are  today;  it  is  not  reasonable  or  efficient  to  do  so  now. 

FORCE-LEVEL  ISSUES 

As  indicated  previously,  Level  4]  is  concmied  with  military  utility.  A  little  refiection  quickly  shows  that  it  is 
comparisons  of  systems  with  respect  to  military  utility  that  allow  top-level  procurement  decisions  to  be  made  and 
justified.  Comparisons  of  lists  of  compoients  (Level  2])  or  of  relative  capabilities  (Level  3])  do  not  allow  or  support 
this  type  of  decision  making.  We  do  not  try  to  rigidly  define  “military  utility”  here.  Cleariy,  however,  it  has  to  do 
with  prosecuting  and  wiiming  engagements,  battles,  and  wars.  If  the  issue  is  readiness  or  tactical  training,  system 
procurement  decision  making,  or  examination  of  operational  alternatives  for  achieving  a  strategic  goal,  then  military 
utility,  rather  than  a  more  narrowly  drawn  technical  characteristic,  is  the  proper  metric  for  facilitating  decisions. 

We  believe  that  military  utility  must  be  observed,  measured,  counted,  or  calculated  in  the  ccmtext  of  actual  or 
simulated  force-level  engagements,  battles,  and  wars.  This  seemingly  irmocuous  belief  is  in  fact  inconsistent  with 
much  of  the  past  practice  in  the  technical  V/L  arena.  Recall  that  Level  4]  metrics  such  as  SSPK  were  taken  as 
reflecting  military  utility  and  that  they  were  calculated  as  a  function  of  values  fw  technical  parameters.  In  some 
cases,  these  calculations  involved  weighting  functions  over  tactical  variables  such  as  degree  of  target  exposure. 
However,  a  laboratory  scientist’s  choices  concerning  the  variables  to  be  considered  or  the  weighting  functions  to  be 
used,  even  if  made  with  the  advice  and  assistance  of  experienced  soldiers,  are  unlikely  to  reflect  the  nuances,  inter¬ 
connections,  and  generalized  fog  of  actual  or  adequately  simulated  combat. 

In  fairness  to  our  predecessors  in  the  technical  V/L  world,  some  of  the  factors  that  caused  them  to  pursue  these 
unsatisfactory  practices  should  be  mentioned.  First,  for  perfectly  good  and  understandable  reasons.  Army  decision¬ 
makers  craved  analyses  that  illuminated  military  utility  rather  than  narrower  technical  factors.  Extant  force-level 
models  were  not  capable  of  using  V/L  metrics  which  were  more  complex.  The  generation  of  SSPKs  was  an  attempt 
by  the  technical  V/L  community  to  respond  to  that  demand,  even  if  the  attempt  was  intellectually  misguided.  Sec¬ 
ond,  intellectually  adequate  combat  simulations  were  simply  not  available  until  recently.  (Some  would  argue  that 
this  overstates  even  our  present  capability.)  Certainly  through  the  1970s,  shortfalls  in  computer  hardware  capability 
and  structured  programming  techniques  were  impediments  to  achieving  adequate  simulaticm  capability.  This  situa¬ 
tion  provided  further  motivation  fcx*  the  technical  V/L  community  to  exceed  its  expertise  and  claim  questions  of  mil¬ 
itary  utility  as  within  its  domain. 

The  partly  overlapping  domains  of  the  technical  vulnerability  experts  and  force-level  modelers  have  caused  fur¬ 
ther  undesirable  consequences  with  respect  to  the  quality  of  our  force-level  efforts.  One  problem  mentioned  earlier 
is  double  counting.  If  a  tactical  variable  such  as  target  exposure  is  included  by  the  vulnerability  community  in  a  util¬ 
ity  measure  such  as  SSPK.  and  then  that  SSPK  is  provided  as  input  to  a  force-level  model  in  which  ocposure  is 
explicitly  modeled,  then  there  is  evident  double  counting.  Similar  arguments  can  be  made  whenever  scenario-type 
factors  are  built  into  the  SSPK. 

A  second  problem  exacerbated  by  the  overlapping  domains  is  the  loss-of-V/L-information  problem  due  to 
excessive  reliance  on  early  averages.  Typical  SSPK  values  are  highly  averaged  and  are  of  relatively  small  value  for 
illumination  of  specific  cases.  This  is  particularly  troubling,  as  noted  earlier,  when  the  information  needed  to  illumi¬ 
nate  a  special  case  was  in  fact  available  as  an  intermediate  result. 

A  third  problem  with  historical  methods  of  attrition  modeling  in  force-level  contexts  is  the  following.  Use  of  a 
single  quantity,  be  it  an  SSPK  or  something  else,  does  not  permit  an  accurate  account  of  the  remaining  capability  of 
the  impacted  target  for  many,  perhaps  for  most,  cases.  The  typical  simulation  draws  a  pseudo-random  number  and 
compares  it  to  the  input  SSPK;  the  target  either  vanishes  or  remains  fully  capable  dqrending  on  the  results  of  the 
draw.  Combat  is  actually  much  more  complex,  and  we  see  in  succeeding  text  that  we  can  do  much  better. 

EXAMPLE:  PROPER  V/L  FORCE-LEVIX  LINKAGE 

We  wish  finally  to  give  a  clear  illustration  of  the  way  in  which  V/L  metrics  (from  Level  2]  and  Level  3])  can  be 
used  to  link  properly  to  a  notional  wargame.  Our  problem  is  to  examine  the  vulnerability  and  mission  effectiveness 
of  a  particular  platform.  As  a  specific  example,  we  use  an  armored  fighting  vehicle  such  as  a  tank.  This  choice 
leads  to  a  particular  set  of  mission-critical  components,  mission-critical  capabilities,  and  finally  minimal  mission 
requirements.  However,  this  process  can  be  applied  to  any  military  platform  by  appropriately  tailoring  the  compo¬ 
nents,  performance  metrics,  and  mission  requirements. 
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Before  any  damage  occurs,  we  can  represent  the  (null)  damage  vector  at  Level  2]  as: 

V^  *  (  Dy  O9  Qy  •  •  •  )  •  (^) 

The  open  squares  (  O )  rgnesent  the  various  undamaged  components  on  the  platform  including  crew,  ammo,  mission 
critical,  and  other.  In  today’s  high-resolution  V/L  simulations*^’*^  a  ground  vehicle  analysis  utilizes  on  the  order  of 
10^  such  components. 

We  can  group  the  components  by  category  to  give  the  Level  2]  vector  v^  the  form: 

V^ **  ( Of  •  •  •  9  QjD#,,,  )  .  (3) 

Crew  Ammo  Fuel  Miss  Crit  Other 

We  now  invoke  the  sequence  of  operators  portrayed  in  Fig.  1.  We  assume  a  shot  is  initiated  at  Level  0];  the  resulting 
munition  hit  point  is  computed  and  passed  to  Level  1].  Next  the  operator  is  used  to  ccxnpute  a  damage  vector, 

V,,  The  effect  of  this  action  might  be  to  transform  the  vector  shown  in  Eq.  (3)  to  the  npticmal  form: 

2 

Vj  )  ,  (^) 

Crew  Ammo  Fuel  Miss  Crit  Other 

where,  as  before,  the  symbol  B  represents  a  killed  crunponent.  The  status  of  platform  survivability  now  can  be 
assessed.  The  number  of  killed  crew  members  is  known,  the  loss  of  ammo  is  known  (along  with  an  estimate  of 
catastrophic  loss  of  the  platform),  and  the  loss  of  fuel  is  known  (along  with  an  estimate  of  catastrophic  loss  of  the 
platform).  The  status  of  Mission  Critical  components  is  known  as  well. 

Next  the  damage  vector  shown  at  Eq.  (4)  is  passed  to  the  mapper,  where  a  Level  3]  capability  vector  of  the 
following  form  is  computed: 

Vj  >(  Mobility,  Firepower,  Commo  )  .  (5) 

For  example,  if  one  of  the  components  killed  is  the  box  providing  IFF^  support,  then  the  corresponding  capability  at 
Level  3]  is  lost  as  well. 

This  vector  can  be  expanded  into  a  more  detailed  expression  of  the  form: 

^’^^INT’^EXT 

where  Mjg  is  the  vehicle  Top  Speed,  Mj^  is  the  Maximum  Range,  Mj^,  is  the  Rough  Terrain  capability,  is  the 
main-gun  Rate-of-Fire,  F^^  is  the  Time-to-Acquire  (a  target),  F^^j  is  the  Hit  Dispersion,  is  the  Internal 
Commo  Capability,  and  is  the  External  Commo  Capability.  For  descriptive  ease,  we  can  choose  to  represent 

these  capability  metrics  as  a  fraction  of  the  nominal  (i.e.,  undamaged)  platform  metrics.  For  the  case  of  the  tank 
being  described,  the  capability  vector  of  Eq.  (6)  can  be  illustrated  in  Fig.  4  in  which  Mobility,  Firepower,  and  Com¬ 
munication  functions  are  displayed. 

In  Fig.  4  (top),  the  three  metrics  of  Top  Speed  (TS),  Maximum  Range  (MR),  and  Rough  Terrain  (RT)  capability 
are  plotted  on  normalized  scales.  Full-scale  value  implies  design  or  undamaged  usability.  The  pointers  to  each 
metric  labeled  AC  indicate  the  post-damage  platform  Actual  Capabilities,  respectively.  Tq)  Speed  is  at  80%,  Maxi¬ 
mum  Range  is  at  80%,  and  Rough  Terrain  is  at  60%  of  undamaged  capability. 

Figure  4  (middle)  illustrates  three  Firepower  metrics,  Rate-of-Fire  (ROF),  Time-to-Acquire  (TTA),  and  Hit  Dis¬ 
persion  (HD).  In  this  example  the  Actual  Capability  (AC)  Rate-of-Fire  is  at  100%  of  the  undamaged  valued,  the 
lime-to-Acquire  is  at  60%,  and  the  Actual  Hit  Dispersion  is  at  20%  of  nominal  value.  This  last  metric  corresponds 
to  an  increase  in  munition  hit  dispersion. 


15.  Paul  H.  Deitz  and  Ridiard  Saucier,  Modeling  Ballistic  Uve-Fire  Events,  Proceedings  of  the  7th  Annual  TARDEC  Symposium,  26-28 
March  1996,  Monterey,  CA;  also  appears  in  Modeling  Ballistic  Live-Fire  Events  Trilogy,  US  Army  Research  Laboratory  Technical  Report 
ARL-TR-1274,  December  1996. 

16.  Paul  H.  Deitz,  Richard  Saucier,  and  William  E.  Baker,  Developments  in  Modeling  Ballistic  Live-Fire  Events,  Proceediiigs  of  the  16th  Inters 
national  Ballistics  Symposium  and  Exhitniion,  23-27  September  1996,  San  Francisco,  CA;  also  appears  in  Modeling  Ballistic  Live-Fire 
Events  Trilogy,  US  Army  Researdi  Laboratory  Technical  Report  ARL-TR-1274,  December  1996. 

t  /FF  stands  for  Identification  Friend  or  Foe. 
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Fig.  4.  niustrative  Examples  of  Actual  versus  (Mission)  Required  Platform  Measures*of-Capability. 
Mobility  graphs  (top)  illustrate  three  metrics.  Top  Speed  (TS),  Maximum  Range  (MR),  and  Rough  Terrain 
(RT)  capability  plotted  on  nonnalized  scales.  The  platform  after-damage  Actual  Capability  for  each  metric  is 
indicated  by  AC.  Firepowo-  graphs  (middle)  illustrate  Rate-of-Fire  (ROF),  Hme-to-Acquire  (TTA),  and  Hit 
Dispersion  (HD).  Communication  graphs  (bottom)  illustrate  Internal  Communications  (INT)  and  External 
Communications  (EXT)  capability.  For  a  specific  mission,  each  metric  is  rated  in  terms  of  a  (minimum) 
Required  Capability  (RC).  In  order  for  the  damaged  platform  to  prosecute  successfully  the  given  mission,  each 
Required  Capability  must  be  equaled  or  exceed  by  the  corresponding  Actual  Capability. 


Firepower 
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Finally  Fig.  4  (bottom)  illustrates  the  platform  Communication  capability.  In  this  case  the  Internal  Communica¬ 
tions  (INT)  Actual  Capability  is  at  full  (100%)  capability  while  the  External  Communications  (EXT)  is  at  60%  of 
undamaged  capability. 

Utility  Mapping:  Approach  One 

Note  that  the  degraded  performance  capability  described  by  Eq.  (6)  and  illustrated  in  Fig.  4  arises  as  a  direct 
consequence  of  the  operator  curating  on  the  non-null  damage  vector,  v^,  of  Eq.  (4).°  As  additional  damage 
occurs  to  the  platform,  the  damage  vector  of  Eq.  (4)  is  further  populated,  and  the  platform  capabilities  represented 
by  Eq.  (6)  continue  to  diminish.  On  the  other  hand,  if  battle  damage  r^air  is  initiated,  then  at  least  some  oi  the 
component  entries  of  Eq.  (4)  move  fixjm  dysfunctional  to  functional,  and  the  related  platftMm  c^)abilities  of  Eq.  (6) 
increase.  In  other  words,  battle  damage,  whether  initial  or  additional,  populates  the  damage  vector,  v^,  while  battle 
damage  repair  acts  to  depopulate  it. 

The  Mission  Mapping  Operator,  has  to  do  with  military  utility,  as  was  suggested  previously,  and  is  in  the 
province  of  the  force-level  analyst  rather  than  the  technical  V/L  analyst.  Frcun  a  strategic  point  of  view,  there  are 
two  different  lines  of  attack  that  historically  have  been  followed  to  gain  the  objective  of  a  credible  mapping. 

One  approach  involves  utilizing  a  group  of  experienced  soldiers  to  consider  a  specified  set  of  (presumably  fre¬ 
quent  or  important)  missions  (»  10).^  For  each  specific  mission,  the  experts  decide  the  minimum  capability  for  each 
metric  required  for  a  successful  completicxi  of  Ae  mission.  The  notional  outcome  of  this  process  is  illustrated  in 
Fig.  4.  The  various  RC  pointers  show  the  minimum  platform  Required  (Capabilities  needed  to  complete  successfully 
a  particular  mission. 

Figure  4  thus  illustrates  that  for  the  military  platform  to  be  successful  fw  the  specific  notional  mission,  the  fol¬ 
lowing  Required  Capability  (RC)  metrics  must  equaled  or  exceeded;  Top  Spe^  of  80%,  Maximum  Range  of 
40%,  Rough  Terrain  capability  of  40%,  Rate-of-Fire  of  40%,  Time-to-Acquire  of  60%,  Hit  Dispo^ion  (rf  1(X)%, 
Internal  Commo  of  1 00%,  and  External  Commo  of  60%. 

The  interpretation  of  the  effect  of  platform  damage  on  the  ability  to  perform  the  mission  is  now  clear.  In  this 
notional  example,  insofar  as  Mobility  is  supported.  Top  Speed  is  Just  adequate,  the  Maximum  Range  capability 
exceeds  the  minimum  requirement,  and  so  does  the  Rough  Terrain  capability.  In  terms  of  Firepower,  the  ^te-of- 
Rre  minimum  capability  is  greatly  exceeded,  the  Tlme-to-Acquire  requirement  is  just  met,  but  the  Hit  Dispersion 
requirement  is  not  nearly  adequate  (1(X)%  Required  Capability  needed  versus  20%  Actual  (Capability).  Finally,  both 
Communication  Actual  (Capabilities  are  equal  to  the  (Mission)  Required  Capabilities.  In  this  example,  the  platform 
is  not  adequate  to  prosecute  the  mission  because  of  the  inaeased  Ifit  dispersion  of  the  tank  main  armament.  Such  a 
situation  might  actually  occur  when  a  tank  is  engaged  against  a  distant  target;  a  greatly  enlarged  hit  dispersion  would 
substantially  lessen  the  probability  of  hit. 

Two  final  observations  for  this  section.  First,  in  addition  to  the  comparison  of  the  (Mission)  Required/Actual 
Capabilities  just  discussed,  the  platform  also  must  have  had  to  pass  the  tests  described  below  Eq.  (4).  That  is  to 
assure  that  no  crew,  ammunition,  or  fuel  events  resulted  in  catastrophic  outcomes  and,  likewise,  that  no  mission  criti¬ 
cal  components  were  lost.  Second,  the  general  logic  structure  described  in  this  rqrort  has  already  been  implemoited 
in  the  context  of  a  personnel  vulnerability  evaluaticsi  tool.  Called  ORCA,*^’**  this  computing  environment  plays 
multiple  threats,  as  required,  against  a  solider  to  compute  [a]  damage,  [b]  the  effect  of  damage  on  various  capabili¬ 
ties  {e.g.,  muscle  strength/coordination,  thinking,  senses),  and  then  [c]  the  capabilities  compared  against  various  mis¬ 
sion  requirements  as  called  for  in  some  20  MOS’s*  comprising  thousands  of  specific  tasks. 


□  Following  £q.  (1),  this  relationship  can  be  written; 

t  What  we  now  describe  is  somewhat  reminiscent  of  the  old  Standard  Damage  Assessment  List  (SDAL)  process  but  is  constructed  so  as  to 
avoid  the  broad  averaging  over  many  missions  and  the  use  of  fractional  capabilities  as  probabilities  of  mission  success.  For  more  detail  on 
the  SDAL  construct,  see  Re&.  10  and  11. 

17,  Kellye  C.  Frew  and  Ellen  M.  Killion,  User*s  Manual  for  Operational  Requirements-based  Casualty  Assessments  (ORCA)  Software  System — 
Alpha+  Version^  Applied  Research  Associates^  Inc^  Report,  Albuquerque,  NM,  July  1996. 

18.  J.  Terrence  Klopcic,  David  N.  Neades,  and  Richard  Tauson,  Operational  Requirements^Based  Casualty  Assessment  (ORCA)  Methodology 
Documentation,  US  Amiy  Research  Laboratory  Technical  Report,  In  Preparation. 

«  MOS  stands  for  Military  Occupational  Specialty.  Each  specialty  is  used  to  define  a  set  of  supportmg  tasks  which  tat  used  to  set  the  mini¬ 
mum  human  capabilities  needed  for  their  successful  prosecution. 
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utility  Mapping:  Approach  Two 

The  second  line  of  attack  is  to  use  a  combination  of  Level  2]  and  Level  3]  vectors  as  input  to  a  force-level 
model.  The  outcome  metrics  of  the  simulated  combat  are,  in  turn,  regarded  as  reflecting  the  military  utility  force 
employed  and  key  platforms  in  that  force.  By  this  process,  the  force-on-force  model  determines  the  success  of  a 
damaged  military  platform  in  a  particular  engagement  Given  adequate  (statistical)  ©cercise  of  such  a  model,  the 
minimum  Requirement  Capability  (RC)  levels  for  various  platform  capabilities  can  be  backed  out  of  the  analysis. 
Experiments  have  been  undertaken  to  develop  this  type  of  mjq).  The  best  documented  of  these  force-level 
experiments  are  those  of  Comstock.*^  We  invite  the  reader  to  study  Comstock’s  results  in  detail;  a  brief  overview  is 
given  here.  This  study  involved  configuring  a  small-unit  force-level  simulation  to  accept  as  V/L  input  either  a  tradi- 
ticmal  SSPK  type  of  input  or  a  distributicm  of  more  rigorously  defined  Level  3]  capability  metrics  consistent  with  the 
V/L  taxonomy.  This  strategy  permitted  a  comparison  of  exchange  ratios  and  other  metrics  as  a  function  of  the  V/L 
input  Unsurprisingly,  Comstock  concluded  that  the  mwe  rigorous  metrics  provided  ,  a  fuller  and  more 
detailed  picture  of  combat  .  .  .  .”  Also,  Baker^  showed  that  the  procedures  lead  to  results  that  are  statistically  dis¬ 
similar. 

Utility  Mapping:  Conclusions 

All  three  of  the  problems  menticxied  previously  in  connection  with  force-level  modeling  are  solved  or  at  least 
mitigated  in  the  Comstock  experiment.  All  traces  of  “utility”  are  purged  from  the  Level  3]  metrics  (and  not,  of 
course,  from  the  SSPKs).  Much  mote  of  the  information  is  retained  in  the  Degraded  States  metrics  than  in  the  even 
mwe  highly  averaged  SSPKs.  Finally,  the  mote  rigorous  methodology  permits  proper  simulation  of  cases  in  which 
systems  remain  on  the  battlefield  with  some  but  not  all  of  their  origind  capability.  This  also  provides  support  for 
wargame  decisions  based  on  reassignment  of  platform  mission  roles  based  on  best  match  of  roles,  given  new 
(reduced)  capabilities. 

Similar  arguments  could  be  made  about  a  second  experiment  pursued  by  the  Army  Research  Laboratory  and  the 
Training  and  Doctrine  Command- White  Sands  Missile  Range  (T^C-WSMR)  over  &e  past  few  years.^*  Although 
the  results  from  that  larger-scale  fcxce-level  simulation  have  not  yet  been  published,  there  appear  no  insuperable 
obstacles  to  pursuing  implementation.  With  the  promise  shown  in  force-level  modeling  experiments  since  at  least 
1990,  one  might  desire  more  rapid  progress.  No  initiative  is  cost-free,  and  even  low-cost  initiatives  are  difficult  to 
prosecute  in  a  Defense  downsizing  environment.  However,  the  delta  cost  on  an  ongoing  business  basis  to  woiic  the 
force-level  problem  properly  is  moderate  while  the  potential  gain  in  information  content  high.  We  believe  that  there 
ate  no  compelling  reasons  for  not  moving  forward. 

CONCLUSIONS 

To  summarize  what  we  have  argued  with  respect  to  the  prosecution  of  V/L  metrics  as  well  as  their  use  in  a  wide 
variety  of  applications: 

•  Use  of  the  V/L  Taxonomy:  The  V/L  Taxonomy  facilitates  clear  distinctions  among  the  metrics  of  damage,  capa¬ 
bility,  and  utility  that  have  often  been  confused.  Specific  outcome  vectors  at  a  given  level  are  different  from  prob¬ 
ability  distributions  formed  from  the  corresponding  family  of  outcomes.  The  probability  of  a  given  outcome  is 
not  equivalent  to  the  utility  of  that  outcome.  These  insights,  as  well  as  other  derivatives  of  this  framework,^  are 
important  in  [a]  the  linkage  of  technology  characterizations  (e.g.,  wariiead/armor  performance)  V/L  models,  [b] 


19.  Gary  R.  Comstock,  The  Degraded  States  Weapons  Research  Simulation  (DSWARS):  An  Jmrestigadon  of  the  Degraded  States  Vulnerability 
Methodology  in  a  Combat  Simulation,  US  Army  Materiel  Systems  Analysis  Activity  Technical  Report  AMSAA-TR-495,  February  1991. 

20.  Wmiam  W.  Baker,  An  Analysis  of  the  Effect  of  the  Degraded  States  Mediodohgyfor  Vulnerability  Assessment,  US  Army  Research  Labora¬ 
tory  Memorandum  Report  ARL-MR-7,  November  1992. 

21 .  Beth  S.  Ward,  Mark  D.  Burdeshaw,  Joe  L.  Aguilar,  and  David  R.  Dinda,  CASTFOREM  Combat  Simulation  Utilizing  Degraded  States  Vtdner^ 
ability  Methodology,  In  Preparation. 

□  For  further  discussion  of  the  Taxonomy  with  respect  to  issues  relevant  both  to  generation  of  V/L  metrics  as  well  as  configuration  issues  in 
foroe-on-foroe  simulations,  the  reader  is  directed  to  Ref.  4. 


-13- 


y> 

the  internal  consistency  of  V/L  models  including  validation  efforts  in  support  of  Live-Fire  simulations,  and 
[c]  the  proper  design  and  implementation  of  force-on-force  models  in  which  they  play  a  critical  role. 

•  Minimization  of  Averaging:  Early  averaging  leads  to  significant  loss  of  V/L  information.  The  elements  of  dam¬ 
age  and  capability  should  be  combined  as  late  as  [nactical  in  the  overall  computation  process.  Advances  in  com¬ 
putational  equipment  have  not  been  fully  exploited  to  avoid  uimecessary  early  averaging. 

•  Redundant  Accounting:  Double  counting  is  a  problem  that  has  historically  affected  the  handoff  fiom  the  tech¬ 
nical  V/L  analyst  to  the  force-level  modeler.  Level  4]  technical  V/L  metrics  have  in  the  past  been  calculated  as  a 
function  of  tactics,  doctrine,  and  scenario.  Thus,  a  utility  metric  supplied  by  a  V/L  analyst  is  (re)introduced  by  a 
force-on-force  modeler  into  a  simulaticm  which  has  as  its  primary  purpose  the  estimation  of  utility.  In  particular, 
when  a  platform  suffers  equipment  damage,  and  the  value  of  that  equipment  varies  significantly  frran  mission  to 
mission,  the  (expected)  estimate  of  utility  is  likely  to  be  in  significant  error.* 

•  Proper  Aggregation  of  Battle  Damage:  Current  wargame  practice  accounts  for  multiple  threats  (whether  ballis¬ 
tic  or  not)  against  a  platform  as  thoigh  each  threat  encounters  an  undamaged  platform.  Except  fOT  the  first 
impinging  round,  the  initial  conditions  (Level  1]  metrics)  for  the  remaining  damage  mapping  operations  (Oj^ 

are  incorrect  An  aggregate  utility  is  estimated  through  the  use  of  the  Survivor  Rule  on  all  of  the  individual 
(incorrectly)  calculated  utflities  rather  than  simply  aggregating  damage  as  damage  (at  Level  2]),  and  then  per¬ 
forming  a  single  mapping  to  uUlity  as  needed. 

•  Assignment  of  Battlefield  Utility:  The  job  of  estimating  battlefield  utility,  is  for  the  watgamer,  not  the 

technical  V/L  analyst.  Level  2]  and  Level  3]  metrics  should  be  used  by  fcHce-level  simulations  in  such  a  way 
that  the  military  utility  is  estimated  for  a  specific  combat  context.  Both  early  averaging  and  double  counting 
must  be  avoided. 

•  Characterization  of  RAM  and  BDR:  The  study  of  Reliability,  Availability,  and  Maintainability  (RAM) 
involves  the  same  mapping  procedure  as  damage  calculation  (02^).  Battle  Damage  Repair  (BDR)  involves 
reducing  the  number  of  entries  of  the  (Level  2])  damage  vector.  There  would  seem  to  be  an  opportunity  to  wok 
both  of  these  analyses  with  the  aid  of  the  vulnerability  analyst  using  a  shared  set  of  naming  conventions,  data, 
and  methods. 

•  Opportunity  for  Wider  Tool  Sharing:  Propcments  of  Weapons  Lethality  and  Platform  Vulnerability  often  share 
tool  sets  and  analysis  approaches  with  effectiveness  evaluatcxs  and  with  force-level  analysts.  However,  their 
agendas  are  often  diverse,  leading  to  a  wide  range  of  required  measures  of  utility  and  levels  of  detail.  More 
interaction  across  the  communities  would  probably  reveal  attainable  improvements  and  greater  efficiencies  fcH* 
all. 


22.  Gary  S.  Moss,  Karen  Ross  Murray,  and  Richard  Saucier,  Description  of  MUVES-SQuASH  Methodology  for  Support  of  Live-Fire  Test  and 
Evaluation,  Proceedings  of  the  XXXVI  Annual  Meeting  of  the  Am^  Operations  Research  Symposium,  13-14  November,  1997,  Fort 
Lee,  VA;  also  US  Amiy  Research  Laboratory  Techiacal  Report,  In  Press. 

23.  Wniiam  £.  Baker,  Richard  Saucier,  Theodore  M.  Muehl,  and  Ricky  L.  Grote,  A  Vidnerability  Model  Comparison  to  Live-Fire  Test  Results, 
Proceedings  of  the  XXXVI  Annual  Meeting  of  the  Amy  Operations  Research  Symposium,  13-14  November,  1997,  Fort  Lee,  VA;  also 
US  Amy  Research  Laboratory  Technical  Report,  In  Press. 

X  Sudi  an  example  might  be  a  night-vision  device  for  a  tank.  Presumably  its  utility  at  night  (e.g..  Mobility  Loss-of-Fimetion)  would  be  one, 
since  the  platform  could  not  be  fought  without  it  However  in  the  day,  it  would  be  uxmeeded.  Given  equal  weighting  of  both  scenarios,  the 
expected  utility  would  be  OS,  greatly  in  error  for  either  of  the  scenarios. 
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FT  BELVOIR  VA  22060-5582 

1  CECOM 

PM  GPS  COLS YOUNG 
FT  MONMOUTH  NJ  07703 

1  GPS  JOINT  PROG  OFC  DIR 

pni  I  PI  AY 

2435  VELA  WAY  STE  1613 

LOS  ANGELES  AFB  CA  90245-5500 

1  ELECTRONIC  SYS  DIV  DIR 
CECOM  RDEC 
J  NIEMELA 

FT  MONMOUTH  NJ  07703 

3  DARPA 
L  STOTTS 
J  PENNELLA 
B  KASPAR 
3701  N  FAIRFAX  DR 
ARLINGTON  VA  22203-1714 

1  USAF  SMC/CED 
DMA/JPO 
M  ISON 

2435  VELA  WAY  STE  1 61 3 

LOS  ANGELES  AFB  CA  90245-5500 

1  US  MILITARY  ACADEMY 

MATH  SCI  CTR  OF  EXCELLENCE 
DEPT  OF  MATHEMATICAL  SCI 
MDN  A  MAJ  DON  ENGEN 
THAYER  HALL 

WEST  POINT  NY  10996-1786 

1  DIRECTOR 

US  ARMY  RESEARCH  LAB 
AMSRLCS  ALTP 
2800  POWDER  MILL  RD 
ADELPHI  MD  20783-1 145 

1  US  ARMY  RESEARCH  LAB 
AMSRLCS  ALTA 
2800  POWDER  MILL  RD 
ADELPHI  MD  20783-1 145 

3  US  ARMY  RESEARCH  LAB 
AMSRLCI  LL 
2800  POWDER  MILL  RD 
ADELPHI  MD  20783-1145 
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No  of 

Copies  Organization 

ABERDEEN  PROVING  GROUND 

4  USARL 

AMSRL  Cl  LP  (305) 
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No  of 

Copies  Organization 


No  of 

Copies  Organization 


1  OUSD  AT  S&T  AIR  WARFARE 
DR  RAiNiS 
RM  3E139 

3090  DEFENSE  PENTAGON 
WASHINGTON  DC  20310-3090 

1  OUSD  AT  S&T  LAND  WARFARE 
MRVIILU 
RM  3B1060 

3090  DEFENSE  PENTAGON 
WASHINGTON  DC  20310-3090 

1  OASD  C31 

DR  SOOS  RM  3E194 

6000  DEFENSE  PENTAGON 

WASHINGTON  DC  20301  -6000 

1  UNDER  SEC  OF  THE  ARMY 
DUSAOR 
ROOM  2E660 

102  ARMY  PENTAGON 
WASHINGTON  DC  20310-0102 

1  ASST  SECY  ARMY  RESEARCH 

DEVELOPMENT  ACQUISITION 
SARD  ZD  ROOM  2E673 

103  ARMY  PENTAGON 
WASHINGTON  DC  20310-0103 

1  ASST  SECY  ARMY  RESEARCH 

DEVELOPMENT  ACQUISITION 
SARD  TT  ROOM  3E479 
DR  MILTON 
103  ARMY  PENTAGON 
WASHINGTON  DC  20310-0103 

1  ASST  SECY  ARMY  RESEARCH 

DEVELOPMENT  ACQUISITION 
SARDZP  ROOM  2E661 
103  ARMY  PENTAGON 
WASHINGTON  DC  20310-0103 

1  ASST  SECY  ARMY  RESEARCH 
DEVELOPMENT  ACQUISITION 
SARDZS  ROOM3E448 
103  ARMY  PENTAGON 
WASHINGTON  DC  20310-0103 

1  OADCSOPS  FORCE  DEV  DIR 
DAMO  FDW 
RM  3C630 

460  ARMY  PENTAGON 
WASHINGTON  DC  20310-0460 


1  OADCSOPS  FORCE  DEV  DIR 
DAMO  FDT 

MR  DENNIS  SCHMIDT 
460  ARMY  PENTAGON 
WASHINGTON  DC  20310-0460 

1  HQ  USAMC 

DEP  CHF  OF  STAFF  FOR  RDA 
ATTNAMCRDA 
5001  EISENHOWER  AVE 
ALEXANDRIA  VA  22333-0001 

1  ARMY  TRNG  &  DOCTRINE  COM 
ATCDB 

FT  MONROE  VA  23561  -5000 

1  ARMYTRADOCANLCTR 
ATRCW 
MR  KEINTZ 

WSMR  NM  88002-5502 

1  ARMY  RESEARCH  LABORATORY 
AMSRLST 
DR  ROCCHIO 
2800  POWDER  MILL  RD 
ADELPHIMD  20783-1197 

1  ARMY  RESEARCH  LABORATORY 
AMSRL  SL 

PLANS  AND  PGMS  MGR 
WSMR  NM  88002-5513 

1  ARMY  RESEARCH  LABORATORY 
AMSRL  SLE 
MR  SHELBURNE 
WSMR  NM  88002-5513 

ABERDEEN  PROVING  GROUND 

1  ARMY  TEST  EVAL  COM 
AMSTE  TM  S 

1  US  ARMY  EVAL  ANALYSIS  CTR 
CSTEEAC  MR  HUGHES 

1  US  ARMY  EVAL  ANALYSIS  CTR 
CSTE  EAC  SV  DR  HASKELL 

1  ARMY  RESEARCH  LABORATORY 
AMSRL  SL  DR  WADE 

1  ARMY  RESEARCH  LABORATORY 
AMSRL  SL  MRBEILFUSS 

1  ARMY  RESEARCH  LABORATORY 
AMSRL  SLE.  DR  STARKS 
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No  of 

Copies  Organization 

ABERDEEN  PROVING  GROUND 

1  ARMY  RESEARCH  LABORATORY 
AMSRLSLB  LTC  GILMAN 

1  ARMY  RESEARCH  LABORATORY 

AMSRLSLB  W WINNER 
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No  of 

Copies  Organization 

1  DEP  ASST  SEC  DEF 
CHEM  BIO  MATTERS 
ATTN  DR  PROCIV 
2451  CRYSTAL  PARK  DR 
ALEXANDRIA  VA  22245 

1  DEFENSE  MAPPING  AGENCY  HQ 
TECH  AND  INFO  DIRECTORATE 
8613  LEE  HIGHWAY 
ATTN  THOMAS  HENNING 
FAIRFAX  VA  22031 -2137 

1  BALLISTIC  MISSILE  DEFENSE 
ORGANIZATION 
ATTN  DEPUTY  TECHNOLOGY 
RM  1  El  48  COL  GARY  PAYTON 
THE  PENTAGON 
WASHINGTON  DC  20310-7100 

1  BALLISTIC  MISSILE  DEFENSE 
ORGANIZATION  ATTN  DTC 
RM  1  El  68  DR  WALTER  DYER 
THE  PENTAGON 
WASHINGTON  DC  20310-7100 

1  BALLISTIC  MISSILE  DEFENSE 
ORGANIZATION 
ATTN  DTE  LTCDALETIETZ 
THE  PENTAGON 
WASHINGTON  DC  20310-7100 

1  DEFENSE  NUCLEAR  AGENCY 
ATTN  DEPUTY  DIRECTOR 
DR  GEORGE  ULLRICH 
6801  TELEGRAPH  RD 
ALEXANDRIA  VA  2231 0-3398 

1  DEFENSE  NUCLEAR  AGENCY 

ATTN  OFTA 
DR  MICHAEL  SHORE 
6801  TELEGRAPH  RD 
ALEXANDRIA  VA  22310-3398 

1  DEPUTY  CHIEF  OF  STAFF 
INTELLIGENCE 
ATTN  DAMI  ST 
DR  BERT  SMITH 
1001  ARMY  PENTAGON 
WASHINGTON  DC  20310-1001 

1  DIR  OPERATIONAL  TEST  &EVAL 
1700  DEFENSE  PENTAGON 
RM  3E318 

ATTN  PHILIP  E  COYLE 
WASHINGTON  DC  20301-1700 


No  of 

Copies  Organization 

1  DIR  OPERATIONAL  TEST  &  EVAL 
1 700  DEFENSE  PENTAGON 
RM  3E318 

ATTN  ERNEST  SEGLIE 
WASHINGTON  DC  20301-1700 

1  DIR  OPERATIONAL  TEST  &  EVAL 
1700  DEFENSE  PENTAGON 
RM1C730A 

ATTN  JAMES  F  O’BRYON 
WASHINGTON  DC  20301-1700 

1  DIR  OPERATIONAL  TEST  &  EVAL 
1700  DEFENSE  PENTAGON 
ATTN  HANS  MAIR 
WASHINGTON  DC  20301-1700 

1  DIR  OPERATIONAL  TEST  &  EVAL 
1700  DEFENSE  PENTAGON 
RM1C730A 

ATTN  THOMAS  R  JULIAN 
WASHINGTON  DC  20301-1700 

1  DIR  OPERATIONAL  TEST  &  EVAL 
1700  DEFENSE  PENTAGON 
RM1C730A 

ATTN  COL  STEPHEN  C  DALY 
WASHINGTON  DC  20301-1700 

1  ODDRNE  AT 

DIR  WEAPONS  TECH 
ATTN  WES  KITCHENS 
3080  DEFENSE  PENTAGON 
WASHINGTON  DC  20301-3080 

1  UNDER  SECY  OF  THE  ARMY 
ATTN  SAUS  OR 
DANIEL  WILLARD 

102  ARMY  PENTAGON 
WASHINGTON  DC  20310-0102 

1  ASST  SECY  ARMY  RESEARCH 
DEVELOPMENT  ACQUISITION 
ATTN  SARD  ZD  RM  2E673 
DR  HERBERT  FALUN 

103  ARMY  PENTAGON 
WASHINGTON  DC  2031 0-01 03 

1  ASST  SECY  ARMY  RESEARCH 
DEVELOPMENT  ACQU ISITION 
ATTN  SARD  TR  RM  3E480 
TOM  KILLION 
103  ARMY  PENTAGON 
WASHINGTON  DC  20310-0103 
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No  of 

Copies  Organization 


No  of 

Copies  Organization 


1  ASST  SECY  ARMY  RESEARCH 
DEVELOPMENT  ACQUISITION 
ATTN  SARD  DOV  RM  2E673 
COL  CORLISS  S  BERRY  III 
103  ARMY  PENTAGON 
WASHINGTON  DC  20310-0103 

1  PROGRAM  EXECUTIVE  OFFICER 
ARMORED  SYS  MODERNIZATION 
ATTN  SFAE  ASM 
WARREN  Ml  48397-5000 

1  PROGRAM  EXECUTIVE  OFFICER 
TACTICAL  WHEELED  VEHICLES 
ATTN  SFAE  TWV 
COL  WILLIAM  J  STODDART 
WARREN  Ml  48397-5000 

1  PROG  EXECUTIVE  OFCR 
AVIATION 
ATTN  SFAE  AV 
MG  DEWITT  T  IRBY  JR 
4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1798 

1  PROG  EXECUTIVE  OFCR 
MISSILE  DEFENSE 
ATTN  SFAE  MD 
BG  DANIEL  L  MONTGOMERY 
PO  BOX  16686 

ARLINGTON  VA  22215-1686 

1  PROG  EXECUTIVE  OFCR 
FIELD  ARTILLERY  SYS 
ATTN  SFAE  FAS 
BG  JOHN  F  MICHITSCH 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROG  EXECUTIVE  OFCR 
TACTICAL  MISSILES 
ATTN  SFAE  MSL 
MR  GEORGE  G  WILLIAMS 
REDSTONE  ARSENAL  AL  35898-8000 

1  PROJECT  MANAGER 
PEO  MISSILE  DEFENSE 
ATTN  SFAE  MD  PA 
COL  STEPHEN  KUFFNER 
PO  BOX  1500 

HUNTSVILLE  AL  35807-3801 


1  PROJECT  MANAGER 

PEO  MISSILE  DEFENSE 
ATTN  SFAE  MD  THA 
COL  WALTER  F  KILGORE 
PO  BOX  1500 

HUNTSVILLE  AL  35807-3801 

1  PRODUCT  MANAGER 

PEO  INTELL  ELEC  WARFARE 
ATTN  SFAE  lEW  RD 
LTC  JAMES  WELLS 
REDSTONE  ARSENAL  AL  35898 

1  PROJECT  MANAGER 
PEO  MISSILE  DEFENSE 
ATTN  SFAE  MD  SM 
COL  THOMAS  HALLER 
PO  BOX  1500 

HUNTSVILLE  AL  35807-3801 

1  PRODUCT  MANAGER 

PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSL  FAD  GTAM 
LTC  JED  A  SHEEHAN 
REDSTONE  ARSENAL  AL  35898-5630 

1  PROGRAM  MANAGER 
ATTN  SFAE  AV  RAH 
BLDG  105 

4300  GOODFELLOW  BLVD 
BG  JAMES  SNIDER 
ST  LOUIS  MO  63120-1798 

1  PROJECT  MANAGER 
ATTN  SFAE  AVAAH 
BLDG  105 

4300  GOODFELLOW  BLVD 
COL  STEPHEN  KEE 
ST  LOUIS  MO  631 20- 1 798 

1  PRODUCT  MANAGER 

ATTN  SFAE  AVSOA 
LTC  MICHAEL  ROGERS 
BLDG  105F 

4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  631 20- 1 798 

1  PROJECT  MANAGER 

ATTN  SFAE  AV  ASH 
COL  EDWIN  GOOSEN 
BLDG  102 

4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  631 20- 1 798 
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No  of 

Conies  Organization 

1  PRODUCT  MANAGER 
ATTN  AMCPM  CH 
JAMES  WINKELER 
4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1798 

1  CMDR  US  ARMY  AVN  TROOP  CMND 
TECHNLGY  APPLCTN  PROG  OFC 
ATTNAMSATDTS 
LTC  WAYNE  KILLIAN 
4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1798 

1  PRODUCT  MANAGER 

ATTNSFAEAVLB 
LTC  HOWARD  BRAMBLETT 
BLDG  105 

4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1789 

1  PRODUCT  MANAGER 

ATTN  SFAE 
LTC  RICHARD  RYLES 
BLDG  105 

4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1798 

1  PROJ  MANAGER  CRUSADER 
PEO  FIELD  ARTILLERY  SYS 
ATTN  SFAE  FAS  CR 
COL  WILLIAM  B  SHEAVES  III 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJ  MANAGER  HTV 

PEO  TACTICAL  WHEELED  VEH 
ATTN  SFAE  TWV  HTV 
COL  JAMES  WANK 
WARREN  Ml  48397-5000 

1  PROJECT  MANAGER  BFVS 
PEO  ASM 

ATTN  SFAE  ASM  BV 
LTC  TED  JOHNSON 
WARREN  Ml  48397-5000 

1  PROD  MANAGER  BFVS  C2V 
PEO  ASM 

ATTN  SFAE  ASM  BV 
LTC  PAUL  WILSON 
WARREN  Ml  48397-5000 

1  PROD  MANAGER  ABRAMS 
PEO  ASM 

ATTN  SFAE  ASM  AB 
LTC  GEORGE  PATTEN 
WARREN  Ml  48397-5000 


No  of 

Copies  Organization 

1  PROD  MANAGER  HAB 
PEO  ASM 

ATTN  SFAE  ASM  CV 
LTC  SAMUEL  M  CANNON 
WARREN  Ml  48397-5000 

1  PROD  MANAGER  Ml  BREACHER 
PEO  ASM 

ATTN  SFAE  ASM  CV 
LTC  DONALD  P  KOTCHMAN 
WARREN  Ml  48397-5000 

1  PROD  MGR  PALADIN  FAASV 
PEO  FIELD  ARTILLERY  SYS 
ATTN  SFAE  FAS  PAL 
LTC  CHARLES  CARTWRIGHT 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJ  MGR  FMTV 

PEO  TACTICAL  WHEELED  VEHICLES 
ATTN  SFAE  TWV  FMTV 
COL  MICHAEL  W  BOUDREAU 
WARREN  Ml  48397-5000 

1  PROD  MGR  IRV 
PEO  ASM 

ATTN  SFAE  ASM  CV 
LTC  ROBERTS  LEES  JR 
WARREN  Ml  48397-5000 

1  PROJ  MGR  MLRS 

PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSL  ML 
COL  STEVEN  WFLOHR 
REDSTONE  ARSENAL  AL  35898-5700 

1  PROJ  MGR  LTV 

PEO  TACTICAL  WHEELED  VEH 
ATTN  SFAE  TWV  LTV 
LTC  BRAD  R  NAEGLE 
WARREN  Ml  48397-5000 

1  PROJ  MGR  HDSB 

PEO  TACTICAL  WHEELED  VEH 
ATTN  SFAE  TWV  HTV 
COL  JAMES  A  WANK 
WARREN  Ml  48397-5000 

1  PROJ  MGR  HMMWV 

PEO  TACTICAL  WHEELED  VEH 
ATTN  SFAE  TWV  HTV 
JOHN  D  WEAVER 
WARREN  Ml  48397-5000 
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No  of 

Copies  Organization 


No  of 

Copies  Organization 


1  PROJECT  MGR  LW 155 
PEO  FIELD  ARTILLERY  SYS 
ATTN  SFAE  FAS  J 
COL  STEPHEN  C  WARD 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJ  MGR  MCD 
PEO  ASM 

ATTN  SFAE  ASM  MCD 

COL  RICHARD  D  NIDEL 

PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJ  MGR  ARMY  TACMS  BA 
PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSLAB 
LTC  KEITH  LENHARD 
REDSTONE  ARSENAL  AL  35898-5650 

1  PROJ  MGR  ARMY  TACMS  BA 

PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSLAB 
LTC  BARRY  WARD 

REDSTONE  ARSENAL  AL  35898-5650 

1  PROJ  MGR  ARMY  TACMS  BA 
PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSLAB 
LTC  ROBERT  ARNONE 
REDSTONE  ARSENAL  AL  35898-5650 

1  PROJ  MGR  ARMY  TACMS  BA 
PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSLAB 
FRANK  WALLACE 

REDSTONE  ARSENAL  AL  35898-5650 

1  PROD  MGR  LB  HELLFIRE 
PEO  TACTICAL  MISSILE 
ATTN  SFAE  MSL  HD 
LTC  DONALD  WILBOURN 
REDSTONE  ARSENAL  AL  35898-5610 

1  PROJ  MGR  JAVELIN 
PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSL  AM 
COL  MICHAEL  RODDY  III 
REDSTONE  ARSENAL  AL  35898-5720 

1  PROJ  MGR  MLRS 

PEO  TACTICAL  MISSILES 

ATTN  SFAE  MSL  ML 

COL  STEVEN  FLOHR 

REDSTONE  ARSENAL  AL  35898-5700 


1  PROJ  MGR  SADARM 

PEO  FIELD  ARTILLERY  SYS 
ATTN  SFAE  FAS  SD 
COL  JAMES  E  UNTERSEHER 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJ  MGR  TANK  MAIN 

ARMAMENT  SYSTEMS  TMAS 
PEO  ASM 

ATTN  SFAE  ASM  TMA 
COL  RICHARD  BREGARD 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJ  MGR  CLOSE  COMBAT 
ANTI  ARMOR  WEAPON  SYSTEM 
PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSL  CC 
COL  ROBERT  ARMBRUSTER 
REDSTONE  ARSENAL  AL  35898-571 0 

1  PROJ  MGR  NON  LINE  OF  SIGHT 
COMBINED  ARMS  NLOSCA 
PEO  TACTICAL  MISSILES 
ATTN  SFAE  MSL  NL 
COL  ROY  MILLAR 

REDSTONE  ARSENAL  AL  35898-5793 

1  PROD  MGR 
USAARDEC 
ATTN  AMCPM  SA 
LTC  JAMES  CAMBRON 
PICATINNY  ARSENAL  NJ  07806-5000 

1  PROJECT  MANAGER 

ARMORED  SYS  INTEGRATION 
PEO  ASM 

ATTN  SFAE  ASM  AS 

COLNEWLIN 

WARREN  Ml  48397-5000 

1  COMMANDER 

US  ARMY  MATERIEL  CMND 
DEP  CHF  OF  STAFF  FOR  RDE 
ATTN  AMCRD 
5001  EISENHOWER  AVE 
ALEXANDRIA  VA  22333-0001 

2  COMMANDER 

US  ARMY  MATERIEL  CMND 
ATTN  AMCRD  IT 
DRPAULEHLE 
MR  MICHAEL  DAILEY 
5001  EISENHOWER  AVE 
ALEXANDRIA  VA  22333-0001 
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No  of 

Copies  Organization 


No  of 

Copies  Organization 


1  CMDR  US  ARMY  MATERIEL  CMND 
PRINCIPAL  DEP  FOR  ACQSTN 
ATTNAMCDCGA 
MR  DALE  G  ADAMS 
5001  EISENHOWER  AVE 
ALEXANDRIA  VA  22333-0001 

1  CMDR  US  ARMY  MATERIEL  CMND 

PRINCIPAL  DEPUTY  FOR  TECH 
ATTN  AMCDCG  T 
MR  MICHAEL  FISETTE 
5001  EISENHOWER  AVE 
ALEXANDRIA  VA  22333-0001 

1  COMMANDER 
USARMYATCOM 
ATTNAMSATG 
4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1798 

1  COMMANDER 

US  ARMY  AVN  TROOP  CMND 
AVIATION  APPL  TECH  DIR 
ATTNAMSATRTV 
FORT  EUSTIS  VA  23604-5577 

1  COMMANDER 

USA  SIM  TRNG  INSTRU  CMND 
ATTN  AMCP  DIS 
COL  JAMES  ETCHECHURY 
12350  RESEARCH  PKWY 
ORLANDO  FL  32826-3276 

1  TECHNICAL  DIRECTOR 

USAARDEC 
ATTN  SMCAR  TD 

PICATINNY  ARSENAL  NJ  07806-5000 

1  ARMY  ARMAMENTS  RDEC 
ATTN  SMCAR  ASM 
FRED  SCHUHMANN 
PICATINNY  ARSENAL  NJ  07806-5000 

1  TECHNICAL  DIRECTOR 
USA  AVN  TROOP  CMND 
ATTN  AMSAT  R  ZT 
ROBERT  KENNEDY 
4300  GOODFELLOW  BLVD 
ST  LOUIS  MO  63120-1798 

1  TECHNICAL  DIRECTOR 

USA  MISSILE  CMND  RDE  CTR 
ATTN  AMSMI  RD 
DR  WILLIAM  MCCORKLE 
REDSTONE  ARSENAL  AL  35898-5240 


1  COMMANDER  ' 

USA  TANK  AUTO  CMND  RDEC 
ATTNAMSTATR 
WAYNE  WHEELOCK 
WARREN  Ml  48397-5000 

1  COMMANDER 

USA  TANK  AUTO  CMND  RDEC 
ATTNAMSTATRD 
COLSCHREPPLE 
WARREN  Ml  48397-5000 

1  COMMANDER 

USA  TANK  AUTO  CMND  RDEC 
ATTNAMSTATRR 
DR  JACK  PARKS 
WARREN  Ml  48397-5000 

1  ARMY  RESEARCH  LABORATORY 
ATTN  AMSRL  D 
DR  JOHN  LYONS 
2800  POWDER  MILL  RD 
ADELPHI  MD  20783-1197 

1  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SL 
LTC  MALONEY 
WSMR  NM  88002-5513 

1  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SLCA 
DR  ROBERT  SUTHERLAND 
WSMR  NM  88002-5513 

5  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SLEA 
R  FLORES  T  MCDONALD 
G  GUZIE  K  NIX  L  ESCUDERO 
WSMR  NM  88002-5513 

4  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SLEV 
K  MORRISON  EZARRET 
J  CUELLAR  O  PAYAN 
WSMR  NM  88002-5513 

3  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SL  EP 
J  PALOMO  D  HUNT 
L ANDERSON 
WSMR  NM  88002-5513 
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No  of 
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2  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SL  EG 
D  HEMMINGWAY 
R  PRICE 

WSMR  NM  88002-5513 

1  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SL  El 
J  NOWAK 

FT  MONMOUTH  NJ  07703-5601 

1  ARMY  RESEARCH  LABORATORY 
SURV  LETH  ANALYSIS  DIR 
ATTN  AMSRL  SLEU 
A  ESTORGA 
WSMR  NM  88002-5513 

1  ARMY  RESEARCH  LABORATORY 
ATTN  AMSRL  CB  PI 
T  WHITE 

2800  POWDER  MILL  RD 
ADELPHI  MD  20783-1197 

1  ARMY  RESEARCH  LABORATORY 
ATTN  AMSRL  PBP 
J  SCZEPANSKI 
2800  POWDER  MILL  RD 
ADELPHI  MD  20783-1197 

1  COMMANDER 

USA  TRNG  DOCTRINE  CMND 
ATTN  ATCD  M 
COL  VOLZ 

FT  MONROE  VA  23651  -5000 

1  COMMANDER 

USA  TRNG  DOCTRINE  CMND 
ATTN  ATCD  H 
COL  HARTMAN 
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